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Abstract. For non convex Hamiltonians, the viscosity solution and the more geo- 
metric minimax solution of the Hamilton- Jacobi equation do not coincide in general. 
They are nevertheless related: we show that iterating the minimax procedure during 
shorter and shorter time intervals one recovers the viscosity solution. 



1. Introduction 
Consider the Cauchy problem for the Hamilton- Jacobi equation 



(H-J) 



dtu{t, x) + H{t, X, dxu) = 0, 
m(0, x) = v{x) 



There are in general no global classical solutions of the Cauchy problem (H-J), 
due to the crossing of characteristics. The only solutions that exist are "weak solutions" 
in the sense of distributions, for example functions verifying the equation almost ev- 
erywhere. However, such solutions are not unique. Different attempts have been made, 
adding conditions on weak solutions to ensure uniqueness and, of course, some physical 
meaning. Roughly, there are two directions in which the pioneers worked: for conserva- 
tion laws, there are entropy conditions, such as Oleinik's in dimension one [Lax73], and 
Kruzkov's for general dimensions [Krii70]; for equations with convex Hamiltonian (or 
initial functions), there are the explicit solution constructed by Hopf formula [Hop65] 
for conservation laws and the Lax-Oleinik formula for general Hamiltonians, which are 
widely used in weak KAM theory, see for example [Fat]. 

In the 1980's, M. G. Crandall, L. C. Evans, and P. L. Lions introduced the notion 
of "viscosity solution" for general nonlinear first order partial differential equations 
[Lio82, CEL84]. Viscosity solutions need not be differentiable anywhere, which makes 
their relationship with the classical crossing of characteristics unclear. However, they 
possess very general existence, uniqueness and stability properties and, in a large class 
of "good" cases, they coincide with the weak solutions introduced before them. 

For general Hamiltonians, with the development of symplectic geometry, M. Chap- 
eron [Cha91] has extended the point of view of Lax and proposed a geometric method 
to construct an explicit weak solution by taking the minmax of a generating family 
of the geometric solution. Then follows the works of T. Joukovskaia, A. Ottolenghi, 
C. Viterbo, F. Cardin, [Jou93, Vit96, Vit06, V095, BCll]. It is shown that this min- 
imax solution coincide with the viscosity solution for convex Hamiltonians [Jou93]. 
However, there are counterexamples showing that they may differ for non-convex 
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Hamiltonians. Indeed, by the uniqueness of viscosity solutions, they must possess a 
semi-group property with respect to time, which is not a general feature of the minmax. 

In this paper, we provide a new formula for the construction of weak solutions for 
the (H-J) equation, called iterated minimax, which is obtained by dividing a given time 
interval into small pieces and taking the minimax step by step. Our main purpose is 
to show that as the small time intervals go to zero, one gets a limit solution which 
is indeed the viscosity solution (see Theorem 3.23). This answers a question of Marc 
Chaperon. 

Acknowledgements. I am grateful for the useful discussions with Marc Chaperon 
and Alain Chenciner. And I wish to thank Patrick Bernard for motivating the actual 
proof of the main theorem, which simplifies the original one. 



We will first give a brief survey of the classical theory, for a closed manifold M, 
of generating families for Lagrangian submanifolds L C T*M and then introduce the 
minmax selector, which serves to extract a section from the Lagrangian. Next we 
pass to the model case M = where we will generalize the classical notions, on 
the one hand, to fit the non-compactness of manifolds, and on the other hand, to the 
Lipschitz case, where we do not have smooth Lagrangian submanifolds but the notions 
of generating family and minmax still exist. 

2.1. General theory for closed manifold. 

Definition 2.1. A generating family for a Lagrangian submanifold L C T*M is a 
function 5 : Af x M^' — t- R such that is a regular value of the map (x, 77) dS{x, rf) / dr] 
and 



more precisely, the condition that is a regular value implies that the critical locus 
S5 := {{x,ri)\driS = 0} is a submanifold and that the map 



is an immersion; we require that is be an embedding and, of course, isC^s) = L. 

A function S on M xM.^ need not have critical points. However, it does have critical 
points if we prescribe some behavior at infinity as in the following definition: 

Definition 2.2. A generating family S* : M x M*^ — )■ M is quadratic at infinity if 

S{x,r]) = ^(x,?7) + Q{r]) 

where Q is a nondegenerate quadratic form and S = Q outside a compact set. 



2. Generating families and minmax selector 




Z5:Ss^T*M, {x,r])^{x,d,S{x,r])) 



The existence of a GFQI is invariant under Hamiltonian isotopy. 
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Theorem 2.3 (Sikorav [Sik87]). Suppose Lq and Li are two Lagrangian submanifolds 
oJT*M which are Hamiltonianly isotopic, and Lq admits a GFQI, then so does Li. In 
particular, any Lagrangian manifold Hamiltonianly isotopic to the zero section Or* a/ 
admits a GFQI. 

Note that the generating families are not unique. Let 5* : M x M'^ — M be a 
generating family of L, then one can obtain another family S generating the same L 
by 

(a) Fiberwise diffeomorphism : S{x,ri) := S{x,ip{x,r])), where (x, 77) h-)- 77)) 
is a fiberwise diffeomorphism. 

(b) Adding a constant: S'(x, 77) := S{x,ri) + C. 

(c) Stabilization: S{x,r],^) := S{x,ri) + q{C,), where g is a nondegenerate quadratic 
form. 

Theorem 2.4 (Viterbo, Theret [Thc99]). // a Lagrangian submanifold L C T*M is 
Hamiltonianly isotopic to the zero section Ot*m, then L admits a unique GFQI up to 
the above operations. 

Now given a Lagrangian submanifold L C T*M with a GFQI 
S : M xR'' R, S{x, ri) = r]) + Q{r]) 
consider the sub-level sets 

S::= {v:S{x,v)<a}, 

the homotopy type of (S*", 5*"") does not depend on a when a is large enough, we may 
write it as (5'^, S~°°). If the Morse index of Q is koo, then 

H.iS- ; Z,) = H,{Q- Z,) { -^-.^^ 

Definition 2.5. The minmax function is defined as 

Rs{x) := inf maxS'(x, 77) 

[(t]=A r;G(T 

where A is a generator of the homology group 7/^^(5'^, S~°°] Z2). A relative cycle a 
of class A is called a descending cycle. 

We can also introduce the maxmin function by considering the homology group 
defined by upper level sets: 

where k'^ = k — koo and X = M*^ is the fiber space. 
Definition 2.6. The maxmin function is defined as 

Ps{x) := sup min S{x,r]) 

where i? is a generator of the homology group Hk/^{X \ 3'°°, X \ S^; Z2). A relative 
cycle a of class B is called an ascending cycle. 
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Remark 2.7. The minmax et maxmin are defined fiberwise for generating families. 
We remark that they are well-defined for functions / : X — )■ R "quadratic at infinity" 
in the sense that the critical set of / is compact and (/°°,/"°°) has the homotopy 
type of ((5°°7 Q~°°) for a nondegenerate quadratic form Q. For example, the condition 
is satisfied if the derivative of / — Q is bounded. This is a simple generalization of 
functions exactly quadratic at infinity which requires f = Q outside a compact set. 

By the uniqueness theorem 2.4, for a given Lagrangian submanifold L, the minmax 
and maxmin are independent of the GFQI, up to a constant. 

Proposition 2.8 ([WEIll]). The minmax and the maxmin are equal, i.e. Rsix) = 
Ps{x). 

The minmax defines almost everywhere a section of the projection T*M — )■ M 
restricted to L ("graph selector"): 

Theorem 2.9 (Sikorav, Chaperon [Cha91, PPS03]). Suppose L C T*M admits a 
generating family quadratic at infinity S, then Rs is a Lipschitz function and there 
exists an open set Q G M with full measure such that for x G fi, 

{x,dRs{x)) e L. 

2.2. The case M = M'*. In the rest of the paper, we will take the manifold M to 
be M'^, in which case the generating families are constructed explicitly. For a general 
manifold, one can embed it into some M*^ and use the trick of Chekanov [Chc96, Bru91] 
to obtain generating families from those in M^. 

2.2.1. Construction of generating functions and phases. In the following, we equip 
with the Euclidien i"^ norm | ■ | , and matrices in M'^ with the associated operator norm. 
We denote by Lip(/) the Lipschitz constant of a function / and by tt : T*M'^ — )■ M.'^ the 
canonical projection 7r(x, y) = x. 

We denote by H : [0,T] x T*M'^ ^ M a Hamiltonian satisfying 

(2.1) ch '■= sup \D'^Ht{x,y)\ < CO 

and by Xnt the associated time-depending Hamiltonian vector field. By the general 
theory of differential equations, as ch = maxf Lip(Dift) = maxt Lip(X//J, the Hamil- 
tonian transformation (p^jf obtained by integrating X^^ from r = stor = tisa 
well-defined diffeomorphism for all {s,t) G [0,T]. For simplicity, we sometimes write 
ipl = (X*, Yg) := yjj^ without mentioning H. 

We will be mostly interested in the special case where H has compact support, and 
consider the Lagrangian submanifolds of T*M.'^ which are Hamiltonianly isotopic to the 
zero section: 

C:={L = ^{dv), veC^n C^'P{R^), ^ e Ham.^{T*W^)}- 
here C'"'p(]R'^) denotes the space of globally Lipschitz functions and 

dv := {(x, dv{x)), x ^W^} C T*W^ 
Ham,{T*M.'^) = = ^h, He C^{[0, 1] x T*M^)} 
where ipn = 'P^h is the endpoint of the isotopy ("Hamiltonian flow") defined by H. 
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Definition 2.10. A diffeomorphism ip : T*W^ T*W^ admits a generating function 
0, if : T*W^ ^ M is of class C^, sucli that ((x, y), (X, Y)) e Grapli((/?) if and only if 

x = X + dy<P{X,y) 
Y = y + dx(p{X,y). 

This can be interpreted as follows: the isomorphism 

/ : T*W^ X T*M^ T*{T*W^) 

^ {X,y,Y -y,x-X) 

is symplectic if T*M'^ is equipped with the standard symplectic form u = dx A dy and 
T*R'^ X r*R'^ with the symplectic form (— © w = dX A c/y — dxA dy; this symplectic 
isomorphism / sends the diagonal of the space T*M'^ x T*M'^ to the zero section of the 
cotangent space T*(T*M'^) and Graph(<y9) to Graph((i0). 

Hence, if it exists, the generating function is unique up to the addition of a constant. 

Lemma 2.11 ([Cha90]). // 

6h :=c^Mn2 

then, for \s — t\ < 6h, the map 

al : {x,y) ^ {Xl{x,y),y) 
is a diffeomorphism. As a consequence, ip\ admits the generating function 

= ((F; - y)Xl - H{T,X:,Yn)dT 

Proposition 2.12 (Composition formula [Sik87]). If a Lagrangian submanifold Lq C 
T*M'^ admits a generating family 5*0 : ffi'^xM*^ — )■ M, then for \ t—s\ < Sh, the Lagrangian 
submanifold (pKLq) has the generating family 

(2.2) S{x, i^,Xo,yo)) = 5'o(xo,0 + <Pl{x,yo) + xyo - x^yo 
The proof is straightforward. 

Corollary 2.13. For each subdivision 0<s = to<ti---<tN = t<T satisfying 
\ti — < Sh, if 4>'^h*'^^ i^ the generating function of ip^^^"'^^ defined in Lemma 2.11, 
we have the following for each function 

i) A generating family S : M.'^ x (T*M"')^ R of the Lagrangian submanifold 
ip^jf{dv) is 

(2.3) Six,?]) = v{xo) + ^ (i)V'^'{xi+i,y,) + ^ (xi+i - Xi)yi, 

0<i<N 0<i<N 

where xn := x, t] = {{x^,y^))Q^^^^. 

ii) One defines a family S : [s,t] x M'^ x (T*]R'^)^ R such that each := 
S{t, ■) is a generating family for ip'^^{dv) as follows: for each r G [tj,tj+i), 

(2.4) ^(r,x,r/) := i;(xo) + 0|'^(xj+i,yj) + ^ 4>V'^\xi+i,yi) + ^ [xi+i - x.-^yi. 

0<i<j 0<i<N 
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iii) For each critical point rj of S{t,x; ■), the corresponding critical value is 
Sr{x- r,) = v{x,) + ^ {y:X- - H{a, XJ, F/)) da, 

where := X"{xQ,dv{xQ)) and Y" := (xq, (if (xq)) . Hence, the critical 
values of S{t,x; ■) are the real numbers 

(2.5) v{X^,{z))+l^ (Y:{z)X?iz)-H{a,X^{z),Y:iz))) da 

with z := {x,y), y G 7r^-^(x) n(p'^j^{dv). 
Proof, i) As the Hamiltonian flow is a "two-parameter groupoid" , we have that 

S,t tOjtjV *JV-li*JV to,ti 

¥>H =<^H =¥>H o ■ ■ ■ o ; 

hence, if — ti\ < 5h for all i, it follows from the composition formula in Proposi- 
tion 2.12 that formula (2.3) does define a generating family for ip^^{dv). 

ii) is clear. 

iii) is proved by inspection (and very important). □ 

2.2.2. Generating families quadratic at infinity. We now give a weaker definition of 
"quadratic at infinity", which will include such cases and take into account the non 
compactness of the base manifold. 

Definition 2.14. A family S* : M x M'^ — )■ M is called quadratic at infinity if there 
exists a nondegenerate quadratic form Q : M'^ — )■ M such that, for any compact subset 
K C M, the restriction ^I/^xr^! modulo a fiberwise diffeomorphism, equals Q off a 
compact set. 

Proposition 2.15 (Proposition 1.20, [WEI13]). Suppose a family S -.W^ ^"K^ is 
of the form 

S{x, rj) = iIj{x, t]) + Q{r]) := £{x, r]) + ipiix, r]) + Q{r]) 
where Q{ri) = ^rj^Brj is a nondegenerate quadratic form, £ is a C"^ function such that 
driC is hounded in K x R'^ for each compact K C M'^, and ipi is with 

(2.6) c:=snp\d'^iJi{x,r])\<\B-^\-\ 
Then S is quadratic at infinity in the new sense. 

Note that a necessary condition for L to admit a GFQI in our new sense is that, 
for any K, the intersection L fl 7r~^{K) be compact and nonempty: indeed, a function 
on M.^ equal to a nondegenerate quadratic form off a compact set must have critical 
points. 

Corollary 2.16. If H has compact support, the generating phases constructed in Corol- 
lary 2.13 are quadratic at infinity when the function v is Lipschitzian. 

Proof. Each 0^'*'+^ has compact support and therefore bounded derivatives. Hence we 
can apply Lemma 2.15 with = 0, £{x; r]) = v{xo) + xyN-i + J2o<i<N (pH^'^^^i+iyVi) 
and Q{ri) := -xn-iVn-i + Eo<i<7v-i(^»+i ~ ^i)yi- ^ 
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There does not always exist a GFQI for L = Lp^^{dv) if H is not compactly supported, 
even when it satisfies (2.1) and v has as little growth at infinity as possible: 

Example 2.17. If the Hamiltonian H e C'^{[0,T] x T*M) is given by H{t,x,y) = 
+ y^, then (p^jf{x, y) = {x cos 2t — y sin 2t, y cos 2t -\- x sin 2t); if v = 0, it follows that 

L := ip^'\dv) = {0} X M 

has empty intersection with ti~^{x) = {x} x M for x ^ and noncompact intersection 
with 7r~^(0), which prevents L from admitting a GFQI. 

When (2.1) is satisfied, however, the Lagrangian L = (p^jf{dv) does admit a GFQI 
for small |s — 1|. Indeed, as is close to the identity, the generating function 0^ is 
"small" compared to the quadratic form, hence Lemma 2.15 applies: 

Corollary 2.18. // (2.1) holds then, for each Lipschitzian function 
there exists a constant a such that for \t — s\ < a, 

S{x] xo, yo) = v{xo) + (I)h{x, yo) + xyo - xoyo 

IS a GFQI for L = <^%\dv). 

Remark 2.19. It is essential that v be Lipschitzian: indeed, if d = 1, H{t, x, y) = \y'^ 
and v{x) = ^x^, then ip^^{x,y) = (x + ty,y) and therefore (p^jf{dv) = {{x + tx'^,x'^)}, 
whose image under the projection vr is a half-line for t ^ 0. 

As the main ingredient in the construction of generating families is the Hamiltonian 
flow, what matters essentially over a given compact subset of R*^ is the region swept by 
the Hamiltonian flow; this is the idea of what is called the property of finite propagation 
speed in [CV08], Appendix A: 

Proposition 2.20. Let [s,t] C [0,T] and L = ip^j^{dv). If for any compact subset 
K C M^, the set 

Uk := U M X {^^^ {^'i^{n~\K))ndv)], 

is compact, then L admits GFQI's in the sense that each L\x := L (1 7t~^{K) has a 
GFQI. 

Proof. For any K, let H = xH, where x is a compactly supported smooth function on 
[0, T] X T*M.'^ equal to 1 in a neighbourhood oiUx- Then formula (2.3) with H := H 
gives a GFQI Sfjioi L\k = if'^{'K-^{K) ndv). □ 

Remark 2.21. One can also truncate v, as the effective region for v is tx [(p^^ {tx~^ [K]^ . 
This may help to localize the minmax. 

Condition (2.1) is not required here, provided H is and such that y?^* is defined 
for all s,te [0,T]. 

Lemma 2.22. // two families S and S' are quadratic at infinity with \S — S'\co < oo, 
then the associated minimax functions satisfy 

\Rs{x) - Rs'{x)\ < l^-^'lco. 
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Proof. If 5" < 5", then by definition Rs{x) < Rs'{x). Hence, in general, the inequahty 
S' < S" + IS* — S"|c70 yields Rs{x) < Rs'{x) + \ S — S'\co. We conclude by exchanging S 
and S'. □ 

Proposition 2.23. Under the hypotheses of Proposition 2.20 and with the notation of 
its proof, the Lagrangian suhmanifold L admits a minmax selector, given by 

R{x) = MmaxSfjix,!]), ifxeKcW^ 

and independent of the truncation H and the subdivision of [s,t] used to define Sfj. 

Proof. Let H and H' be two truncations for H on Uk as in the proof of Proposition 2.20. 
Let if^ = fiH + {1 — fi)H', /i G [0, 1]; as the constant c^m of (2.1) is uniformly bounded, 
one can find a subdivision s = to < ti ■ ■ ■ < tN = t satisfying \ti — < for all 
/i (see Lemma 2.11); if denotes the corresponding GFQI of L\k = L H 7i~^{K) for 
< /i < 1 then, by Lemma 2.22, as 5^ depends continuously on /x, so does the minmax 
Rsf,{x) for X E vr(L). 

On the other hand, Rsf,{x) is a critical value of the map rj H- S^{x, 77), and, by (2.5), 
the set of all such critical values is independent of /i and the subdivision, and depends 
only on Uk] as it has measure zero by Sard's Theorem, Rs^{x) is constant for n G [0, 1]. 

The fact that the critical value Rs{x) itself does not depend on the subdivision is 
established in Lemma 3.4. □ 

Example 2.24. If the base manifold M = T'^, taking its universal covering W^, we 
can consider : M'' — t- R a periodic function and H : W x T*M.'^ R periodic in x. 
Then in order that L = ip^^{dv) admits a GFQI, it is enough to require that the flow 
ip^^ is well-defined for r G [s,t]. Indeed, since dv is compact, Ure[s *]{''"} ^ V^ui^'^) 
compact, hence the condition of finite propagation speed is satisfied automatically. 

Example 2.25. The following hypotheses satisfy the finite propagation speed prop- 
erty: 

\dyH\ < C'^il + |x|), \d^H\ < Cnil + \y\), 

It is a classical condition for the existence and uniqueness of viscosity solutions in R"^, 
see [CL87]. 

2.3. Generalized generating families and minmax in the Lipschitz cases. Al- 
ready if c? = 1, H{t,x,y) = 1?/^ and v{x) = arctanx, the Lagrangian submanifold 
ip^j^^{dv) = { (a; -|- j:^, '■ x G R} is not the graph of a function for t > large 

enough, and the minimax of its generating phase St{x; xo,yo) = arctanxo -l- |?/o + 
{x — Xo)?/o is not a function, though it is locally Lipschitzian (see Proposition 2.31 
herafter). 

Hence, in order to to iterate the minmax procedure, one is led to defining the minmax 
when the Cauchy datum is a Lipschitzian function. We will use Clarke's generalization 
of the derivatives of functions in the Lipschitz setting [Cla83], see the Appendix. 

Proposition 2.26. Under the hypothesis (2.1) and with the notation of Corollary 2.13, 
if V is only locally Lipschitzian, the family S given by (2.3) generates L = ^p'^^^dv) in 
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the sense that 

L = {{x,d,S{x;r]))\0 e dr,S{x;r])}. 
where d denote Clarke's generalized derivative and dv := {{x,p),p G dv{x)}. 

Proof. The equation G dr)S{x; rf) means that G dv^Xo) and y^+i = ^^^^^^^'^'"''^(xj+i, fji), 
Xi = for < 2 < A^,where x := Xn et r] = {xi,yi)o<i<N- □ 

However, this definition of a generating family is not invariant by fiberwise diffeo- 
morphism, even by the following very simple (and useful) one: 

{x;{xi)o<i<N,{yi)o<i<N) H- (x, (xj+i - Xi,?/i)o<j<Af) =: (a;, fc, |/i)o<i<iv) ; 
indeed, it transforms the family S given by (2.3) into 

0<i<N i<j<N 0<i<N 

for which d^S'^x; {^i,yi)o<i<N) is not a point, but the subset 

0<i<N i<j<N 

As often, this difficulty is overcome by finding the right definition*: 

Definition 2.27. A Lipschitz family S* : M'^ x — )■ M is called a generating family for 
L C T*M'^ when 

L = {{x,y) G T*R'^\37] G : (y, 0) G 9^(x,r/)}. 

Lemma 2.28. This definition of a generating family is invariant by fiberwise dif- 
feomorphisms. 

Proof. If $(x, 77') = (x, 0(x,?7')) is a fiberwise diffeomorphism of M'^ x M^, and S" : = 
5*0$, then the chain rule (see the Appendix, Lemma A. 31) yields 

dS\x, v') = {{y + C|:0(x, V), C|70(x, v')) I {y, e dS{x, 0(x, V)) } ; 

as 7]' I—)- </)(x, r/') is a diffeomorphism, it does follow that the two conditions 
3r/ G : (y, 0) G 95(x, r]) and V G M'^ : (y, 0) G 95'(x, r]') 
are equivalent. □ 

We are now ready to consider GFQI's for the elements of 

C:={L = if{dv), V G C^'P(M'^), if G Ham,{T*R'^)} : 



*But this example exhibits one of the features of the Clarke derivative: the relation (y, 0) £ dS'{x, r/) 
is definitely not equivalent to y 6 dxS'{x,ri), £ d^-S'{x,rj) and E dy.S'{x,ri). 
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Proposition 2.29. If H : [0, T] x T*M'^ -^R is C'^ and has compact support then, for 
each V G C^^^{M.'^), the generating family of L = (p^j^ (dv) G C given by (2.3), namely 

S{x;ri) = v{xo) + ^ + ^ (xi+i - Xi)yi, 

0<i<N 0<i<N 

where Xn '■= x, rj := ((^^j, |/j))Q<-^^, is "quadratic at infinity" in the following sense: 
let 

Q(r]) := -xn-Wn-i + ^ {xi+i - Xi)yi, 

0<i<N-l 

the Lipschitz constant of each S{x, ■) — Q : (T*]R'^)^ — t- M zs bounded, uniformly with 
respect to x on each compact subset ofM.'^. 

Hence, for each compact K C M^, G C^(M'^, [0, 1]) equals 1 in a neighbourhood 
of 0, there exists a positive constant ax such that the function 

(2.7) SK{x;r]) = iJK{x]r]) + Q{r]), where ^pK{x;ri) ■= 9 (^-^^ {S{x,r]) -Q{r])), x e K 
is a GFQI of Lk := L n 7r~\K). 

In the sequel, unless otherwise specified, we consider families S of the form (2.3) and 
families Sk of the form (2.7). The advantage is that they are in x, in which case 
dS{x,ri) = dxS X dr^S{x,ri). This is not essential, but simplifies our formalism and 
arguments. 

To study the minmax function Rs for such S, we use the extension of classical results 
in critical point theory to locally Lipschitz functions described in the Appendix. 

Proposition 2.30. The minmax Rs{x) is well-defined and it is a critical value^ of the 
map rj ^ S{x,ri). For each compact subset K ofM.'^ and each truncation Sk of S of 
the form (2.7) generating Lk, we have that Rs{x) = Rsjf{x) for x G K . 

Proof. By Proposition 2.29, fijf) := S{x,ri) = ipirf) + Q{rf) with ip Lipschitzian and 
Q a nondegenerate quadratic form. Hence, / satisfies the P.S. condition (Appendix, 
Example A. 28). If c = Rs{x) were not a critical value, the fiow (py of Theorem A. 29 
in the Appendix would deform the descending cycles in /'^^'^ into descending cycles in 
Z*^"^, hence the contradiction c = inf max^. / < c — e. 

To see that Rs\k = Rsk^ J^^t notice that every descending cycle a of S{x,-) or 
Sk{x, ■), X & K, can be deformed into a common descending cycle a' with max ^(x, o"'(-)) = 
maxSK{x,<j'{-)) by using the gradient fiow of Q, suitably truncated. □ 

Proposition 2.31. The minmax Rs{x) is a locally Lipschitz function. 

Proof. Let K G M'^ he compact. By Proposition 2.30, we have that Rs\k = Rsk^ 
where Sk : -R' x M''" — )■ M writes S{x,ri) = ipK{x,ri) + Q{r]) with Q a nondegenerate 
quadratic form and tpK a compactly supported Lipschitz function. Given x,x' G K, 



^Appendix, Definition A. 27. 
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for all e > 0, there exists a descending cycle a such that SKix,r]) < Rsix) + e; 

if max^g^. Sk{x', rf) is reached at fj, then 

Rs{x')-Rs{x) < Sk{x' ,f]) - SK{x,ff) + e = i)K{x' ,ff) - i)K{x,ff) + e 
< Lip{ipK)\x — x'\ + e. 

If we let e and exchange x and x', we obtain 

\Rs{x) - Rs{x')\ <Up{i:K)\x - x'\, 

which proves our result. □ 

Proposition 2.32. The sets C{x) = {77 1 G driS{x,r]), S{x,r]) = Rs{x)} are compact 
and the set-valued map ("correspondence") x 1— )■ C{x) is upper semi-continuous; for 
every convergent sequence {xk,r]k) — ^ {x,ri) with rjk G C{xk), one has rj E C{x). In 
other words, the graph C = {(x, 77) 1 77 G C(x)} of the correspondence is closed. 

Proof. Let {xk,rik) — )■ (x, 77) with rjk G C(xfc); then, as 5* is in x, dS = dxS x 
drjS. Now dS : {x,r]) t-j- d^S x 9^5* is upper semi-continuous (Appendix, Proposi- 
tion A. 26), the limit [dxS{x,r]),0) of the sequence {dxS{xk,f]k),0) ^ dS{xk,r]k) be- 
longs to dS{x,rj), hence G djjS{x,ri); as the continuity of S and Rs implies that 
S{xk,rik) — )■ S{x,r]) and Rs{xk) — )■ Rs{x), this proves 77 G C{x). □ 

Lemma 2.33. Given any 6 > 0, there exists an e > such that 

Rsix) = inf max S(x,ri) 

where = {a | max^- S'(a:, 77) < Rs{x) + e} and Cs{x) = Bs{C{x)) denotes the 6- 
neighborhood of the critical set C{x). 

Proof. This is a direct consequence of the deformation lemma (Appendix, Theorem A. 30) 
for Sx := 5'(x, ■): for S > 0, and c = Rsix), there exist e > and V such that 
ipyiS^'^" \ Csix)) C 5'^~^ In particular, we remark that for cr g S^, the intersec- 
tion cr n Csix) is non vide, otherwise, the flow ipy may take a to a descending cycle 
a' = fvid) such that max.f,go-' Sxirj) < Rsix) — e, contradiction with the definition of 
minmax. □ 

Remark 2.34. When S is C^, the Sx^s are generically Morse functions: indeed, Sx is 
Morse if and only if a; is a regular value of the projection vr : L — )■ M , (x, p) 1— )■ x, whose 
regular values, by Sard's theorem and the compactness of Grit (6*3;), form an open set 
of full measure. In this case, is indeed a deformation retract of 5'^+'^ for e > small 
enough, hence inf max deserves its name "minmax" , that is, there exists a descending 
cycle a such that, Rsix) = max^. S'(x, 7/) = ma.x^QC(x) Six,r]). 

Proposition 2.35. The generalized derivative of Rs satisfies 

(2.8) dRsix) C co{dxSix, t/) 1 7/ G C(x)} 



^Appendix, Example A. 28. 
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Proof. First, we claim that, if Rs is differentiable at x, then 

(2.9) dRs{x) C co{d^S{x, v)\v^ C{x)} 

Take 6 and e for x as in Lemma 2.33. Consider K = Bi{x), and Sk obtained in Lemma 
2.15, one can choose a. g E {0, 1) such that for x G Bg{x), 

\Sk{x, ■) - Sk{x, ■)\co < e/4. 

Now let y E M.'^ and A < be small such that X\ := x + Xy E Bg{x) and < e/4. 
Then by Lemma 2.33, for each xx, there is a descending cycle ax such that 

maxS'(xA,?7) < Rsi^x) + A^ 

then 

maxS'(x,?7) < maxS'(xA,?7) + t < Rsi^x) + < ^5(^) + -r 

and 

Rs{^) < niax S{x,ri) = S{x,r]x), for some ?7a G cta nC5(x). 
Hence we have 

(2.10) X~'[Rs{xx) - Rs{x)] < X''[S{xx,Vx)-S{x,7]x)]-X 

(2.11) = {d^S{x'x,vx),y)-K 

where the last equality is given by the mean value theorem for some x'^ in the line 
segment between x and xx- 

Take the limsup of both sides in the above inequality and let 5 — ?■ 0, we get 

{dRs{x),y) < max {d,S{x, 7]), y), \/y eR'' 

r]GC{x) 

Note that this implies that dRs{x) belongs to the sub-derivative of the convex func- 
tion f{y) := max^^c(x){dxS{x,ri),y) at v = 0,^ for which one can easily calculate 

dfiO) = co{d,Six,r]):r]eCix)}. 

Thus we get (2.9). In general, 

dRs{x) = co{ lim dRs{x)} C co{co lim {d^S{x' ,r]'),7]' G C{x')}} 

x'—^x x'—^x 

C co{d^S{x, r]),r] e C{x)} 
by the upper-semi continuity of x i— )■ C{x) and the continuity of dxS. □ 

The formula (2.8) gives us somehow a generalized graph selector, while for a classical 
graph selector, we require that for almost every x, 

dRs{x) = dxS{x,ri), for some 77 G C{x) 

from which {x,dRs{x)) G L. 

If S* is a GFQI of L = ip{dv) G £ for i; G C^, then Sx := S{x, ■) is an excellent 
Morse function for almost every x, in which cases C{x) consists of a single point, hence 
dRs{x) = dxS{x,r]) for a unique 77, proving that Rs is a true graph selector for L. 



''Recall that, for a convex function /, the sub- derivative at a point x is the set of ^ such that 

f{y)-fix) > {^,y-x)yy 
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Question 2.36. Is the minmax Rs also a true graph selector for L ^ C. 

Question 2.37. Is it true that, when Rs is differentiable at x, one has (x, dRs{x)^ G L7 
Here L G £ or even C 

3. Viscosity solutions and minmax solutions 

We look at the solutions of the (H-J) equation, assuming that H G C^([0, T] x T*R'^) 
and V G C^^p(M'^) satisfy the condition of finite propagation speed. Unless otherwise 
specified, we assume that H has compact support (as a function on [0, T] x T*T'^ when 
H and v are periodic). 

3.1. Geometric solution and its minmax selector. Following the classical geomet- 
ric method for first order partial differential equations, the Hamilton- Jacobi equation 
is considered to be a hypersurface in the cotangent bundle T*(]R x M*^). 
More precisely, let 

n{t,x,e,p) =: e + H{t,x,p), it,x,e,p) G T*(R x R"^) 

and at the moment suppose that the initial function v is C^. 

Definition 3.1. Let denote the Hamiltonian flow of "H, which preserves the levels 
of "H, and let 

= \^(0,x, —H(0,x,dv{x)),dv{x))^ ; 
then, the geometric solution of the Cauchy problem (H-J) is 

Lh,v ■= [J fui^v)- 

s6[0,T] 

It is a Lagrangian submanifold containing the initial isotropic submanifold and 
contained in the hypersurface 

n-\0) = {{t,x,e,p)\e + H{t,x,p) = 0} C T*(M x W^). 

As every Lagrangian submanifold L of T*(M x R'^) contained in '^"^(O) is locally 
invariant by ipy^, this geometric solution is in some sense maximal. 

Writing T*(M x M^) as T*R x T*R°', we have = (1, -dtH^Xn), and 

Ln,. = {{t,-H{t,ip'Hidv)),ip'H{dv)) , t G [0,T]} 

where (f\j := (f^jf is the Hamiltonian isotopy generated by H. 

Lemma 3.2. Formula (2.4) defines a GFQI 

S : [0, T] X M"^ X M^' ^ R 

of Ln,v 
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Proof. For simplicity, we may assume that T G (0, Sh), hence that 

S : [0, T] X M'^ X m"" M, S{t, x, xq, yo) = v{xo) + xyo + yo) - xoVo- 

Let (xo,i/o) e Ss, then 

{dtS{t,x,Xo,yo),d^S{t,x,Xo,yo)) = ?/o), <9^0H(a;, yo)) = i-H{t, x,y{t)),y{t)), 

where {x,y{t)) = ip^jj{xo,yo) with i/o = c?^;(xo). 
Hence 

{{t,x,dtS{t,x,xo,yo),d^S{t,x,xo,yo))\{xo,yo) E S5} = 

□ 

If there exists a function u : [0, T] x M*^ — )■ M such that 

L = Ln,v = {{t, X, dMt, x), dMt, x)) C T*([0, T] x R'')} 

we say that L is a 1-graph in T*([0, T] x M'^). In this case, m is a global solution of the 
Cauchy problem of (H-J) equation. In general, L may be the graph of the derivatives 
of a multi-valued function. 

An equivalent but more economic way to describe the geometric solution is to identify 
each ipy^(Ty) with {s}xip^^{dv) by the inverse of the map (t, x,p) {t, x, —H(t, x,p),p). 
In this way, we also call the union 

Lh^^ ■= [j {t} X ipHidv) C M X T*R'^ 

tG[0,T] 

a geometric solution. 

If we look at the projection of the characteristics, that is, the image of the graph 
of the solutions { (t, v9^(xo,po)) j^gjQ ^.p {xo,Po) G T*W^, of Hamilton's equations under 
the projection 

TT : [0,T] X T*R'^ ^ M X M'^, {t,x,p) ^ {t,x). 

then L is not a 1-graph when the corresponding characteristics intersect under the 
projection. Without ambiguity, we will simply say that the characteristics intersect. 

Now, as before, we consider more generally the Lipschitz case. Given v G C^'p(M''), set 

r„ = {{0,x, -H{0,x,p),p) : p G dv{x)} 

and similarly 

Ln,v = U M^.) = {{t,-H{t,ip'Hix,p)),ipUx,p)):pedvix),te[0,T]] 

se[o,T] 

Lh,v = U ^ fnidv) ■■= [j {t} X {fHix^p) : P e dv{x)} 

te[0,T] tG[0,T] 

where d is Clarke's generalized derivative. We call Ly^,^ or Lh,v generalized geometric 
solutions. They are also generated by the GFQI given by formula (2.4) on page 5. 



VISCOSITY SOLUTION OF HAMILTON- JACOBI EQUATION BY A MINIMAX METHOD 15 

Definition 3.3. For any time < s < t < T, we define ttie minimax operator^ 
for tlie (H-J) equation as 

W^v{x) = inf max S{t, x, rf) 

•n 

wliere S : [s, t] x M'^ x "K^' ^ M is given by (2.4). 

For completeness, witliout referring to tfie uniqueness tlieorem for GFQI's, we give 
a proof that the minmax is well-defined independently of the subdivisions. 

Lemma 3.4. The minmax Rs{x) = inf max S'(a;, 77) given by (2.3) or (2.4) is indepen- 
dent of the subdivision of time in the construction of S. 

Proof. First assume t — s < 6h', given r G (s,t), consider the family of subdivisions 
Cm + /i(r — s) < t}; then, 

S^{x; xo, yo, xi,yi) = v{xo)+(j)'H^^^^~'\xi,yo) + {xi-xo)yo+(f)''H^^^~'^'\x, yi) + ix2-xi)yi , 

where X2 := x, is the generating family defined by (2.3) and associated to C/^, A* ^ (0, 1]. 
The function S*^ is continuous in /i and the minmax Rs^{x) is the critical value of the 
map r] 1— )■ S^{x]ri) with rj := {xo,yo,Xi,yi). By 2.5, the set of all such critical values 
is independent of /i; as it has measure zero by Sard's Theorem, Rs^ is constant for 
/i G [0, 1]. In particular, letting x[ := Xi — Xq and yQ = yo — yi, we get 

Soix; Xo, yo, xi, yi) = So{x; (xq, yi, x[, y'^)) = v{xo) + (f)'j^\x2, yi) + (xs - xo)yi + x^y^. 

It is obtained by adding the quadratic form x[yQ to 

S{x;xo,yi) = v{xo) + 0^*(x2,?/i) + (x2 - xo)yi, 

which is the generating family related to Co- We conclude that Rs{x) = Rso{x) = 
Rs,{x). 

In general, given any two subdivisions C', C" of [-s,^] with" |C'|, |C'| < ^h, denote by 
( = (' U (" = {s = tQ < ■ ■ ■ < tn = t} the subdivision obtained by collecting the points 
in C' and C"- If tj is not contained in C', we consider the family of subdivisions 

Cm(j) = {^0 < tj-i < + fi{tj - tj^i) < tj+i <■■■ tn], fi G [0, 1] 

The same argument as before shows that the minmax relative to Co(j) and Ci(j) are 
the same. Continuing this procedure, we get that the minmax relative to C' and C are 
the same, and the same holds for C" and C- Therefore the minmax with respect to C' 
and C" are the same. □ 

Lemma 3.5. If v e n C^'p(M'^), then R^^v{x) verifies the (H-J) equation almost 
everywhere. 

Proof. This is a direct consequence of the fact that S* is a GFQI of „ and the minmax 
is a graph selector in this case. □ 

^The inclusion R%'' {C^'^ {W^)) C C^'p{W^) is proven in Proposition 3.17 p. 20. 
"For a subdivision C, = {to < ■ ■ ■ < we let |(^| :~ max^ — ti\. 
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In general, for a Lipschitzian initial function, we do not know whether the minmax 
verifies the equation almost everywhere or not. But in view of the estimation of gen- 
eralized derivatives in Proposition 2.35, we still call R^jfv{x) the (generalized) minmax 
solution of the Cauchy problem of (H-J) equation. 

Lemma 3.6. Ifv is with bounded second derivative, then there exists an e > such 
that for t G [0, e), the minmax R^jfv{x) is . 

Proof. We will show that, there exists an e > 0, such that for t G (0,e), the char- 
acteristics beginning from the graph dv do not intersect. More precisely, the map 
/t : Xo Xq(xo, dv{xo)) is a diffeomorphism. Indeed, for t small enough, 

Up{ft - Id) < Lip(a* - Id){l + Up{dv)) < 1 

where ag and ch are defined in Lemma 2.11. This in turn means that the projection 
map L = (p*'fj{dv) M'', H- x is a diffeomorphism, hence L = {x,dR^jfv{x)}, 

from which we obtain that R^v{x) is . □ 

3.2. Viscosity solutions. 

Definition 3.7. A function u G C°((0,T) x M'^) is called a viscosity suhsolution (resp. 
supersolution) of 

dtu + H{t, X, dxu) = 

when it has the following property: for every tp G C^((0,T) x M*^) and every point 
(t, x) at which u — ip attains a local maximum (resp. minimum), one has 

dt^ + H{t, X, d^ip) < 0, (resp. > 0). 

The function m is a viscosity solution if it is both a viscosity subsolution and superso- 
lution. 

We remark that one can replace test functions ip by C°° test functions in the 
definition. Obviously, a classical solution is a viscosity solution. Indeed, we have 

Lemma 3.8. A viscosity solution verifies the equation wherever it is differentiahle. 

Proof. Just observe that, iiip — u reaches a local minimum (resp. maximum) at a point 
(t,x) where u is differentiahle, then dip{t,x) = du{t,x) and use the definition. □ 

The existence of viscosity solutions is ensured by the so-called "vanishing viscos- 
ity method" at the origin of the name "viscosity". The approach is to consider the 
approximate problem 



(HJ, 



dtu' + H{t, X, d^u') = eAu' 

M^(0, x) = v{x) 



for e > 0. This quasilinear parabolic Cauchy problem turns out to have a smooth 
solution u*^, as the viscosity term eA regularizes the Hamilton- Jacobi equation. 

Proposition 3.9 ([CEL84]). The sequence {u''}^ tends to the viscosity solution of the 
(H-J) problem as e — )■ 0. 
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Uniqueness follows at once from the following estimate: 

Proposition 3.10 ([CL87]). Ifui andu2 are viscosity solutions of the Hamilton- Jacobi 
equation, then 

sup [ui{t, x) — U2{t, x))~^ < sup (mi(0, x) — ^2(0, x))'*'. 



This proposition gives more than uniqueness: it provides a monotonicity property 
for viscosity solutions with respect to the initial condition: if mi(0, ■) < ^2(0, ■), then 

Ml < U2- 

Theorem 3.11 ([CL87]). Ifv e C^'p{R'^)) and H e C^{[0,T]xT*R'^) , then there exists 
a unique viscosity solution of the Cauchy problem of the Hamilton- Jacobi equation. 
Moreover, this solution is globally Lipschitz. 

A notable feature of the viscosity solution, is that it is Markovian, meaning that, if 

denotes the viscosity solution operator (for a fixed Hamiltonian) which to v associates 
the time t of the solution equal to v at time s, then the "two-parameter groupoid" 
property 

is satisfied. This follows easily from uniqueness. 

The following Proposition summarizes a well-studied case when the Hamiltonian is 
convex in p, one can refer to [Jou93, ChaQO, WEI13]. 

Proposition 3.12. Assume H G C^([0,T] x T*W^) strictly convex in p, equal to \p\^ 
off a compact set, and v G C^'p(M'^). Then the minmax solution is reduced to a min, 
and it possesses the "semi-group" property with respect to time, that is 

Rov{x) = Rio R'qv{x), 0<s<t 

Proof. Our hypotheses imply that there exists a constant en > such that, for < 
t — s < en, the Hamiltonian diffeomorphism (pi of H has a classical generating function 
^1{X, x) in the sense that ((x, y), {X, Y)) E Graph((y9) if and only if 

Y = dxtlj{X,x) 
y = -d^^{X,x). 

Therefore, for any < s < t < T, the subset L = ipl{dv) has the generating family 
F,*(x; {xi)o<i<j) = v{xo) + ^*(x, (x^)) := v{xo) + i;^+'{xi+i,Xi) 

0<i<j 

where and {s = To < Ti < • ■ ■ < Tj^i = t} is a subdivision of [s, t] such that 

|rj — Tj+il < en, < i < j. Up to diffeomorphism, F* is quadratic of index at infinity, 
since H equals |pp off a compact subset. Thus the minmax is reduced to min: 

Rlv{x) = minF*(x, (xj)) 

(Xi) 
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Note that by Lemma 3.4, R\ is independent of the choice of the subdivision, hence 
R\oRlv{x) = min (i?^t;(xo) + (Xi))) 

= min (min(i;(x[,) + %{xo, {x'^))) + (xi))) 
ix^) V (xr) / 

= , min [v{x'^) + %{x, (x^), (x;.))) = R\v{x) 

□ 

Remark 3.13. The hypothesis that H = |pp at infinity can be generahzed to the case 
where the condition of finite propagation speed is satisfied. The min solution operator 
i?o is a finite dimensional "discretization" of the Lax-Oleinik semi-group in weak KAM 
theory, defined by 

T>(x)= inf {t;(7(s)) + /;L(t,7(t),7WMt} 

7(t)=x 

where L is the Legendre tranform of H with respect to the p variable, and the inf is 
taken over all absolutely continuous paths 7 : [s, t] — ?■ M'^. 

Theorem 3.14 ([Jou93]). The min solution Rqv{x) is the viscosity solution of the 
Cauchy problem (H-J). 

A generalization of Theorem 3.14 can be made from convex Hamiltonians to the 
convex-concave type Hamiltonians. Consider the Cauchy problem (H-J) with 

(SP) H{t,X,p) = Hi{t,Xi,Pi) + H2{t,X2,P2), V{x) = Vi{Xi) + V2{X2) 

where {x,p) = {xi,X2,pi,P2) ^ T*M.'^, and Hi and H2 are strictly convex and concave 
in p respectively. We may assume that each Vi is globally Lipschitz and Hi verifies the 
condition of finite propagation speed. 

Let S(^H,v) denote the GFQI related to {H,v), i.e. the GFQI of the Lagrangian 
submanifold ^9^:} (dv), then we get a GFQI of (pj{dv) 

2 

S(H,v){t,X,^) = y^^S(^H,,Vi)(t,Xi,^i) 
i=l 

Due to the product formulas for both the minmax and the viscosity solution (see for 
example Lemma 2.39, 2.40 in [WEI13]), we have 

Proposition 3.15. Suppose that H and v satisfy (SP), then the minmax solution 
R\jv{x) = X]i=i -^//i^(^i) viscosity solution of the (H-J) equation. 

3.3. Iterated minmgix and viscosity solution. In contrast to the case of convex 
Hamiltonians, where the minmax is reduced to a min and provides the viscosity solu- 
tion, for general non-convex Hamiltonians, the minmax and the viscosity solution may 
differ: see [Vit96, V095, BCll] for counterexamples, and also [Che] for a very nice 
geometric illustration of the fact that the viscosity solution is not necessarily contained 
in the geometric solution. 
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Particularly, in [Vit96], the author pointed out without proof that the minmax does 
not provide a semi-group as a consequence of not being viscosity. We will make this 
point clear by showing that the semi-group property is a sufficient condition for the 
minmax to be viscosity. 

Proposition 3.16. Given v, the minmax B^^v{x) is the viscosity solution of the 
Cauchy problem (H-J) if and only if it has the semi-group property with respect to 
time, that is, 

R°jfv{x) = R"h^ o R°^\,{x), 0<s<t<T. 

Proof. Suppose Rqv{x) := R^^v{x) possesses the semi-group property, we first show 
that Rqv{x) is a viscosity subsolution. For any {t,x), let ip he a. function such that 
ip{s,y) =: ips{y) > Ro'^iy): with equality at (t,x). It is enough to consider -i/; in a 
neighborhood of (t, x), where it has bounded second derivative. Then 

(3.12) ijt{x) = R\o Rlv{x) < R\i)r{x). 

By Lemma 3.6, for t — r > small enough, the characteristics originating from dip^ do 
not intersect: let {xt,yt) = (f^^{xr, dxipTixr)) , where (f denotes the Hamiltonian flow of 
H, then the map p : {xr,dxipT{xT)) ^ Xt is a diffeomorphism. Therefore R\.iI)t{x) is a 
classical solution of the (H-J) equation. Hence 

(3.13) RlM^) = Mx) - H{s, X, dxRltpr{x))ds 

Moreover, since {x,dxR\-ipT{x)) = ip^. op~^[x), we get that dxR^-iprix) is continuous in 
r. 

Subtract (3.13) into (3.12), move il^t{x) to the RHS, divide both side by t — r and 
let r — )■ t, we get 

< -dtiptix) - H{t,x,dxilJt{.x)) 

from which we get a subsolution by definition. Similarly, we can prove that Rqv{x) is 
a viscosity supersolution. 

Conversely, if Rqv{x) is the viscosity solutions , by the uniqueness of viscosity solu- 
tion, it satisfies the semi-group property. □ 

As a direct consequence, we get Theorem 3.14 since the min solutions form a semi- 
group (Proposition 3.12). 

We remark that Proposition 3.16 does not essentially depend on the variational for- 
mulation of the minmax. P. Bernard has shown a more general statement, containing 
the minmax as a special case. It says that if an operator has the semi- group prop- 
erty, monotonicity, and compatibility with the (H-J) equation, then it is the viscosity 
solution operator, see Proposition 20 in [Bcrll]. 

To compensate the defect of the minmax for not being a semi-group, an idea due 
to M. Chaperon is to replace the "minmax" by some "iterated minmax". Roughly 
speaking, an iterated minmax is obtained by dividing a given time interval into small 
pieces and take the minmax step by step. This is a priori a discrete semi-group with 
respect to the points of the subdivision. We are going to show that, as the steps of 



20 QIAOLING WEI 

the subdivision go to zero, the iterated minmax will converge to a real semi-group, and 
therefore to the viscosity solution. 

In the following, we denote the Lipschitz constant of a global Lipschitz function / 
by \\df\\ and \ ■ \k denotes the maximum norm on a compact set K. 

Lemma 3.17. Assuming H G C^{[0,T] x T*R"') and v G C^'p{R'^), we have the 
following estimations: 

1) -R^* defines an operator from C^^'^{W^) to C^^^(R^), with Lipschitz constant 

mR%\')\\ < \\dv\\ + \\d.,H\\\t-s\ 

2) For anyO< s <ti<T, i = l,2, 

(x) — < |ti — ^2! max \H{t,x,-)\Y 

where Y = {y : \y\ < \\dv\\ + maxj |tj — s\}. 

3) Let and be two Hamiltonians, then 

\R%v - Rlfivlco < |t - s| max - H^){t, ■,y)\co 

where Y' = {y : \y\ < \\dv\\ + maxj |t — 

4) Ifv^,v^ G C^^P(M°') and K is a compact set in M.'^, then there exists a bounded 
subset K gM.'^ which depends on K x [0,T] and the constants ||i9f*||, such that 

(3.14) - R'hV\k < |f° - v^lj,. 

Proof. The proof is based on Proposition 2.35 with some variation on the original 
variable x, which can be either t G [0,T], or x G or some parameter A for the 
generating family constructed as below. 

For simplicity, we may first assume that \t — s\ < 6h so that 

S''\x,xo, yo) = v{xo) + (pnix, yo) + xyo - xoyo 

Let (x(r),?/(r)) denote the Hamiltonian flow, and C{x) be the critical set defined in 
Proposition 2.35. 

1) For (xcyo) £ C{x), we have 

d^S''\x, xo, yo) = d^(f)%\x, yo) + yo = yit) 

where 

yit) = yo- da,H{T,x{T),y{T))dT, yo G dv{xo) 



Hence by (2.8), 

dR^J'vix) C co{y(t), yo G dv{xo)} 

thus 

\\diR%'v)\\ < \\dv\\ + \\d^H\\\t-s\. 
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2) For (xo,yo) ^ C{x), we have 

dtS''\x,xo,yo) = dt(f)'H\x,yo) = -H{t,x,y{t)) 

Hence 

dtR^vix) C co{-H(t,x,y(t)), yo G dv{xo)} 

from which 

|-R^*^f (x) — -R^*^t'(x)| < |ti — ^2! max \H{t,x,y)\ 
where Y = {y : \y\ < \\dv\\ + H^^;//!! maxj |tj — 

3) Let = (1 — X)H'^ + XH^ , X G [0, 1], and let S^^ be the corresponding generating 
famihes. Fix A, for (a;o,yo) in the critical set C'*'(x) corresponding to iJ'^, 



dxSx\x,xo,yo) = dx4>H\{x,xo,yo) = - H^){T,x^{r),y^{T))dT. 

J s 

Hence ^ 

dxR%{v{x) C co{ [ - H^){r,x\r),y\r))dr, y, G dv{x^)} 

J s 



from which 



\R%,v{x) - R''^^v{x)\ < 



f f\H'-H\r,x\r),y\r))dTdX 
< \t-s\ max |(ff°-/7i)(r,-,y)|co 
where Y' = {\y\: \y\ < \\dv\\ + maXj ||i9x--f^'|| |^ — s\}. 

4) Let = {1 — X)v^ + Xv^, A G [0, 1] and 5*^'* denotes the corresponding generating 
families, then dxS^''{x, Xo,yo) = f^^o) ~ ^'"^(^^o); 

dxR%'v\x) C co{t;^(xo) -t;°(xo) : (xo,yo) e C\x)} 
withC^x) C {{xo,yo) : |xo| < \x\+T\\dy{H\{y^Y})\\}, Y := {y : \y\ < \\dv\\+T\\d,H\\}. 
If we take K = {xq : |xo| < \x\k + T\\dy{H\^y(zY})\\}, we obtain 

I r>s.t r>s.t 1 1 ^ I 1 1 
\Rjj V — Rjj V \k < \v — V 

In general, the above results follow from the fact that the critical set C{x) defines 
the Hamiltonian flow (x(r), i/(r))s<r<t for any 0<s<t<T. □ 

Remark 3.18. The estimates in the proposition, more subtle than needed, precisely 
reveal that being with finite propagation speed is enough to define the minmax function. 

Now given any compact subset K C M'^, we consider (t, x) G [0,T] x K. 
Given a subdivision (n = {0 = to < ti < ■ ■ ■ < tn = T} of [0, T], for each s G [0, T], 
we associate to it a number m(Cn, s), depending on (n '■ 

m{Cn, s) := i, if U < s < U+i. 

For simplicity, fixing a subdivision, we may abbreviate m{(n, s) as m(n, s). 
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Definition 3.19. The iterated minmax solution operator ioi the (H-J) equation with 
respect to a subdivision C„ is defined as follows: for < s' < s < T, 

When the Hamiltonian H is fixed , we may abbreviate our notation i?^* as i?*, and 
the iterated minmax as 

(3.15) Kn--=Rl , o...rY"''^+\ 

for which we call it a n-step minmax, with a subdivision indicated. 

Define the length of Cn by |Cn| := maxj \ti — Suppose that{C«}n is a sequence of 
subdivisions of [0,T] such that tends to zero as n goes to infinity, and {RQ,^v{x)}n 
be the corresponding sequence of iterated minmax solutions for an initial function 

Lemma 3.20. The sequence of functions Un{s,x) := Rq^v{x) is equi-Lipschitz and 
uniformly bounded for {s,x) G [0,T] x K. 

Proof. By Lemma 3.17, one can verify that 

\\d{Rl^v)\\<\\dv\\+T\\d,H\\, 

\Ro,n^ - Rl,n^\K < \H\K\s-tl S,tG [0,T]. 

where /C := {{t,x,y) : t G [0,T],x G K, \y\ < \\dv\\ + T\\d,H\\}. 
In particular, taking t = 0, we get 

\RlnV\K <\v\k + T\H\!c, sg[0,T] 

□ 

It follows immediately from the Arzela-Ascoli Theorem that {R^^v{x)}n has uni- 
formly convergent subsequences on [0, T]xK. Fixing a convergent subsequence {Rq„^^v{x 
we write its limit as 

R'qv{x) := lim Rlr^A^)- 

Remember that Rqv{x) depends a priori on the specified subsequence of subdivisions 
{Cnfcjfe, which itself depends on the given initial function v and the given subdivi- 
sions {Cn}n- We define the related limit operator for -Ry „^ with respect to the fixed 

subsequence of subdivisions {Cnk}k- for any time < s' < s < T, 

Rgi := hm i?^, „ , if the limit exists 

fc->-oo ' 

Lemma 3.21. We have 

(3.16) Rov{x) = lim R^, „ o R''v{x) = R^, o Rf!v{x), VO < s' < s < T. 

Proof. For brevity, we omit the subindex k oi n^. 
We first claim that 

(3.17) R'ov{x) = lim i?o7„<"'^'i;(a;) 
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Indeed, 

< \H\ic{s -tni(n,s)) <\H\lc\Cn\ ^0, U ^ OO. 

Now we suppose the uniform convergence of {Rq''^"'"'' v{x)}n on a bit larger set K x 
[0,T] where K D K a.s defined in 4) of Lemma 3.17. Then for any e > 0, there exists 
large enough such that for any i,j > N, 



l^o?"'^-^o?"'^lx<e, v.e [o,r] 



Hence 



I ■rJ'm(i,s) T-)^m(i.s') T-)^m(i,s) I I T-)^m(i,s) T-J'm(j,s') j~\^m{i,s) Tt^mii.s' ) I 

\Rt : ni°Roi ^ - R^i = \Rt . ,i°Roi ^ - Rt . Mi°^Oi 

' ''m(i,s')i' '-''J ^i' ' ' ''m(i,s')i' ^iJ ''m(i,s')i' ' 



^ I D*'"(3.s')„, D*'"(»' = ') „, I ^ , 



Let j go to infinity, we get 



Thus 

^^^(x) = limi?;-;-;,,o^^'^(x). 
We conclude by verifying the following, which is similar to (3.17), 



hm i?:, , o R^^v{x) = hm R^^;-] o R^^v{x). 

2— >-CJO ' I— >-00 m(2,s )' 



□ 



Proposition 3.22. Rqv{x) is the viscosity solution of the (H-J) problem. 



Proof. We first show that it is a viscosity subsolution. For any {t,x), suppose i/j a 
function defined in a neighborhood of {t,x), having bounded second derivative and 
such that ip{s,y) =: ipsiu) > Ro'^iu)^ with equality at {t,x), 

iPt{x) = R^vix) = lim i?* o Rlv{x) < lim R^^^^x) = R^M^) 

the last equality holds for t — r small enough, where the characteristics originating from 
dipT do not intersect, hence the iterated minmax is nothing but the 1-step minmax 
which is the classical solution. We conclude by applying the same argument in 
Proposition 3.16. The proof that Rqv{x) is a supersolution is similar. □ 

For given H and v, we say that the limit of iterated minmax solutions exists in [s, t], 
if for any sequence of subdivision {Cn}nGN of [s,t] such that — )■ as ra — )■ cxd, the 
related sequence of iterated minmax solutions {R'^j^^^^v{x)}n£N, (t, 2;) G [s,t] x M"' con- 
verges uniformly on compact subsets to a limit which is independent of the choice of 
subdivisions, then, without ambiguity, we denote this limit also by R^^v{x). As before, 
in the case where H is specified once and for all, we may write the iterated minmax 
solution and its limit by Rl^v{x) and Rlv{x) respectively. 

We can now prove our main Theorem 
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Theorem 3.23. Suppose H G Cl(\Q,T]xT*W^) andv G C^'p(R'^), then for the Cauchy 
problem of the Hamilton- Jacobi equation 

r dtu + H{t,x,d^u) =0, te{0,T] 
\ m(x,0) = v{x), X G W^. 

the limit of iterated minmax solutions exists and coincides with the viscosity solution. 

Proof. For any compact subset K and (t, x) ^ [0,T]x K, and given any sequence of 
subdivisions {Cn}n, setting Un{t,x) = Rq(-^v{x), we have proved in Proposition 3.22 
that any convergent subsequence of {un}n converges uniformly on [0,T] x K io the 
viscosity solution. Now, by Lemma 3.20 and the Arzela-Ascoli theorem, the sequence 
of functions u„ takes its values in a compact subset of C°([0, T]xK), hence it converges 
to the viscosity solution. □ 



Appendix. Lipschitz critical point theory 

We will give a brief review on Lipschitz critical point theory, extracted from Appen- 
dix B in [WEI13]. Let us consider a real locally Lipschitz function / on** X := M.''. 

Definition A. 24. The Clarke generalized derivative df{a) of / at a G X is the convex 
subset df{a) of X* = T*X defined as follows: by Rademacher's theorem, the set 
dom{df) of differentiability points of / is dense in X; if df := : x G 

dom((i/)}, we let 

df{a) ■.= co{yeX* ■.{a,y)edf}, 

where co stands for the convex hull; in other words, df{a) is the convex hull of the set 
of limits of convergent sequences df{xn) with limx„ = a. As |c?/(x)| is bounded by the 
local Lipschitz constant of / for x close to a, every sequence df{xn) with lim 
bounded and therefore has a convergent subsequence, implying 

Va G X df{a) ^ 0; 

moreover, df{a) is compact, being the convex hull of a compact subset. The subset 

df ■.= {{x,y)\yedf{x),xeX} 

is a generalized version of the enlarged pseudograph defined for semi-concave functions 
in [Arnll], where the pseudograph is df. In simple one-dimensional cases, it is obtained 
by adding a vertical segment to df where / is not differentiable: 

Remark A. 25. The set df{x) consists of a single point if and only if / is "C^ at x 
with respect to the set where it is differentiable" . 

Proposition A. 26. The set-valued function x H- df{x) is upper semi-continuous: for 

every convergent sequence (x„,?/„,) — )■ {x,y) with yn. G df{xn), one has y G df{x). In 
other words, df is closed. 



"The theory extends to reflexive Banach spaces [Cha81]. 
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Definition A. 27. A point x G A is called a critical point of / if G df{x); the 
number f{x) is then called a critical value of /. By Proposition A. 26, the critical set 
Crit(/) of /, consisting of its critical points, is closed in A. 
Setting 

A(x) := min 

we say that / satisfies the Palais-Smale condition (P.S.) if every sequence (x„) along 
which f{xn) is bounded, and such that X{xn) goes to 0, possesses a convergent subsequence- 
whose limit is a critical point of / by Proposition A. 26, as there is a sequence ?/„ G 
df{xn) converging to 0. 

Example A. 28. The P.S. condition is satisfied when Lip(/ — Q) < oo for some non- 
degenerate quadratic form Q on A; moreover, in that case, Crit(/) is compact. 

Proof. Indeed, if ip '■= f — Q, each subset df{x) = dip{x) + dQ{x) consists of vectors 
whose norm is at least \dQ{x) \ — Lip{ip), hence A(x) > — Lip{ip), which tends 

to +00 when |x| — )■ oo; therefore, there exists R > such that every sequence (xn) 
with limA(x„) = satisfies < R for all large enough n, implying both the P.S. 
condition and the compactness of Crit(/). □ 

Theorem A. 29 (Deformation Lemma I). Suppose f satisfies the P.S. condition and 
let := {x\f{x) < c} for each c G M. If c is not a critical value of f , then there exist 
e > and a bounded smooth vector field V on X equal to off f'^^'^'^ \ f'^~'^^, and whose 
flow i^^y satisfies C /"-^ 

Theorem A. 30 (Deformation Lemma II). Suppose f satisfies the P.S. condition. If 
c & is a critical value of f and N any neighbourhood of Kc := Crit(/) n/~^(c), then 
there exist e > and a bounded smooth vector field V on X equal to off f^^^"^ \ f'^~'^'', 
whose flow ify satisfies ^y^f^^" \ A) C /'^~^ 

Lemma A. 31 (Chain rule). If f : X ^ is a Lipschitz function, F : X ^ X a 
diffeomorphism, then 

d{f o F){x) = df{F{x)) o dF{x) := {rfF(x)(0, ^ e df{F{x))} 
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